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AMENDMENT UNDER 37 C.F.R. §1.111 Atty Dk. No. Q61834 

Appln. No.: 09/916,210 

AMENDMENTS TO THE CLAIMS 

This listing of claims will replace all prior versions and listings of claims in the 

application: 

LISTING OF CLAIMS: 

1. (currently amended): An object activity modeling method comprising the steps 

of: 

(a) obtaining an optical flow vector from a video sequence; 

(b) obtaining4he a probability distribution of-the a feature vector for a plurality of video 
frames, using the optical flow vector, wherein the feature vector is an d x L dimensional vector, 
d being a number of dimensions and L being a number of pixels in a video frame or in a region 
of interest; 

(c) modeling states, using the probability distribution of the feature vector; and 

(d) expressing the activity of the object in the video sequence based on state transition. 

2. (original): The object activity modeling method of claim 1, wherein the step (a) is 
based on affine motion estimation. 

3. (original): The object activity modeling method of claim 2, wherein the step (a) 
further comprises the sub-steps of: 
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(a-1) grouping input video frames into a plurality of video frame groups and dividing 
each video frame group as an individual state; 

(a-2) obtaining an affine motion parameter for each video in the video frame group of 
each individual state; and 

(a-3) obtaining an optical flow vector from the affine motion parameters. 

4. (currently amended): Th e object activity mod e ling m e thod of claim 3 An object 
activity modeling method comprising the steps of: 

(a) obtaining an optical flow vector from a video sequence; 

(b) obtaining the probability distribution of the feature vector for a plurality of video 
frames, using the optical flow vector; 

(c) modeling states, using the probability distribution of the feature vector; and 

(d) expressing the activity of the object in the video sequence based on state transition, 

wherein the step (a) is based on affine motion estimation and further comprises the sub- 
steps of: 

(a-1) grouping input video frames into a plurality of video frame groups 
and dividing each video frame group as an individual state; 

(a-2) obtaining an affine motion parameter for each video in the video 
frame group of each individual state; and 

(a-3) obtaining an optical flow vector from the affine motion parameters, 
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wherein the step (a-2) comprises a step for determining parameters, which 
minimizes summed square difference ^ (I t (x) - I t _, (x - V(x))) 2 over a given 

video based on the intensity of the pixel on the object, which is expressed as 
I t (x)=I t _i(x-V(x)) when I denotes intensity, t denotes time, x denotes a pixel 
location (x, y), and v denotes the motion vector, as motion parameters. 



5. (currently amended): Th e object activity mod e ling method of claim 1 An object 
activity modeling method comprising the steps of: 

(a) obtaining an optical flow vector from a video sequence; 

(b) obtaining the probability distribution of the feature vector for a plurality of video 
frames, using the optical flow vector; 

(c) modeling states, using the probability distribution of the feature vector; and 

(d) expressing the activity of the object in the video sequence based on state transition, 

wherein the step (b) comprises a step for calculating probability distribution P(Z|Q) by 
the following equation: 

exp(-^(z-m) T )Q- 1 (Z-m)) 

P (Z| Q ) = 175 

H (27l) N |Q| 1/2 

wherein P=(pi,p2, ... Pd) denotes a motion vector calculated at each pixel location (x, y), L 
denotes the number of pixels in a video frame or a region of interest, d denotes the number of 
dimensions, feature vector Z, which is a d x L dimension vector, is 
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Z = (pJ,pf,...,p 1 L ,p 1 2 ,P2v..,P2 > Pd ) Pd 5 ...Pd) T i mis the mean vector of feature vector Z, and Q is 
the covariance matrix of feature vector Z, and it is assumed that feature vector Z is provided 
from observation class £2. 

6. (currently amended): The obj e ct activity modeling method of claim 1 An object 
activity modeling method comprising the steps of: 

(a) obtaining an optical flow vector from a video sequence; 

(b) obtaining the probability distribution of the feature vector for a plurality of video 
frames, using the optical flow vector; 

(c) modeling states, using the probability distribution of the feature vector; and 

(d) expressing the activity of the object in the video sequence based on state transition, 
wherein the step (b) further comprises the steps of: 

decomposing covariance matrix Q as the following equation: 



Wherein Z is equal to Z-m, the columns of 4> are orthonormal eigenvectors of 
covariance matrix Q, and A corresponds to the diagonal eigenvalue; and 

calculating probability distribution P(Z|Q) by the following equation: 



Q=3> A<D T 
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wherein M is the number of principal components, y* is the i-th component of Y, a* is the 

1 N 

i-th eigenvalue of Q, and p is the optimal value, which is obtained by p = V a, , and it is 

n-m j£n 

assumed that feature vector Z is provided from observation class £2. 

7. (original): The object activity modeling method of claim 1, wherein in the step 
(c), the object activity in the video sequence is expressed using a Hidden Markov Model 
(HMM), based on state transition. 

8. (currently amended): The obj e ct activity modeling method of claim 7 An object 
activity modeling method comprising the steps of: 

(a) obtaining an optical flow vector from a video sequence; 

(b) obtaining the probability distribution of the feature vector for a plurality of video 
frames, using the optical flow vector; 

(c) modeling states, using the probability distribution of the feature vector; and 

(d) expressing the activity of the object in the video sequence based on state transition, 

wherein in the step (c), the object activity in the video sequence is expressed using a 
Hidden Markov Model (HMM), based on state transition, and 

wherein the Hidden Markov Model (HMM) is expressed as X={S, A, B, 11} when N is 
the number of possible states, E satisfies S = {qi, q2, qN}> A is {aij}, the transition between 



6 



AMENDMENT UNDER 37 C.F.R. 8 1.111 Atty Dk. No. Q61834 

Appln. No.: 09/916,210 

hidden states i and j, B is {bj(.)}, the observation symbol probability corresponding to state j, and 
n is the initial state distribution, and the state S = {qi, q2, qisi} and the initial state distribution 
II are determined in advance based on video data. 

9. (original): An object activity recognition method comprising the steps of: 

(a) obtaining feature vectors by motion estimation for video frames; 

(b) determining a state, to which each frame belongs, using the obtained feature vectors; 

and 

(c) determining an activity model, which maximizes the probability between activity 
models and a video frame provided from a given activity model dictionary using a transition 
matrix for the determined state, as the recognized activity. 

10. (previously presented): The object activity recognition method of claim 9, 
wherein the step (c) comprises a step of finding an activity model, which maximizes probability 
P(0|X) from the given activity model dictionary {X u ^2, ^e}> when T is a positive integer 
indicating the number of frames forming the video sequence, Z\, Z 2 , Z T are feature vectors of 
first frame, second frame, T-th frame, respectively, and if video frame 0={Zi, Z 2 , Z T } is 
given and E is the number of state models. 
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1 1 . (original): The object activity recognition method of claim 10, wherein the 

transition matrix is obtained by using an expectation-maximization (EM) algorithm based on the 

observation symbol probability {bj(.)} corresponding to scene j in the training process. 
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